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Using  a  colocated  multiple  input/multiple  output  (MIMO)  radar 
system,  we  consider  the  problem  of  joint  design  of  amplitudes  and 
frequency -hopping  codes  for  frequency-hopping  waveforms.  The 
joint  design  method  yields  better  combined  code  and  amplitude 
matrices  that  result  in  improved  performance  over  that  of  separate 
designs.  We  propose  a  game  theory  framework  for  the  joint  design. 
First,  we  present  the  MIMO  radar  signal  model  and  the  sparse 
representation.  Then  the  problem  formulation  is  constructed  based 
on  sparse  recovery  and  the  ambiguity  function  of  the  MIMO  radar 
system  for  frequency-hopping  waveforms.  For  amplitude  design,  we 
propose  two  strategies:  amplitude  design  with  separate  constraints 
and  amplitude  design  by  fusing  all  transmitters.  We  formulate  a 
novel  game  model  and  propose  two  joint  design  algorithms,  one 
applying  a  noncooperative  scheme  and  the  other  applying  a 
cooperative  scheme.  Owing  to  the  extremely  large  size  of  the  feasible 
set  of  the  discrete  code,  we  propose  to  use  these  algorithms  to  obtain 
the  e-approximate  equilibrium.  We  demonstrate  the  improvement  of 
the  resulting  codes  and  amplitudes  through  numerical  examples. 
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Multiple  input/multiple  output  (MIMO)  radar  [1-6]  is 
an  active  technology  that  is  attracting  the  attention  of 
researchers  due  to  the  improvement  in  performance  it 
offers  over  conventional  single  antenna  systems.  In  the 
traditional  standard  phased-array  radar,  the  system 
transmits  only  scaled  versions  of  a  single  waveform.  The 
MIMO  radar  system  allows  transmitting  multiple  probing 
signals  that  may  be  chosen  quite  freely,  obtaining  more 
degrees  of  freedom  than  systems  with  a  single  transmit 
antenna  [7] .  MIMO  radar  systems  are  commonly  used  in 
two  different  antenna  configurations:  distributed  [2]  and 
colocated  [3].  Both  distributed  and  colocated  MIMO 
radars  exploit  waveform  diversity,  and  it  has  been  shown 
that  both  radars  have  many  advantages.  In  this  paper, 
whenever  we  mention  MIMO  radar,  we  are  referring  to 
colocated  MIMO  radar. 

The  frequency-hopping  waveforms,  proposed  in  [8], 
were  originally  designed  for  multiuser  communications, 
radar,  and  sonar  systems.  Because  frequency-hopping 
signals  can  be  easily  generated  and  have  constant  modulus, 
they  have  been  considered  effective  radar  waveforms.  In 
[4-6],  the  authors  used  the  frequency-hopping  codes  to 
exploit  waveform  diversity  for  colocated  MIMO  radar 
and  considered  adaptive  waveform  design.  The 
MIMO  ambiguity  function  is  used  to  optimize  the 
frequency-hopping  codes  in  [5],  with  the  assumption  that 
the  target  Dopplers  are  small.  The  extension  of  the  small 
Doppler  condition  to  the  general  case  was  conducted  in 
[4],  which  applied  the  hit-matrix  formalism  to  design  the 
code  matrix.  Both  frequency-hopping  code  and  amplitude 
designs  are  considered  in  [6]  by  using  sparse  modeling, 
but  they  were  designed  separately.  Our  goal  in  this  paper 
(see  also  [9])  is  to  jointly  design  the  codes  and  amplitudes. 

Multiobjective  optimization  problems  can  be  found  in 
various  fields,  wherever  optimal  decisions  need  to  be 
made  in  the  presence  of  trade-offs  between  two  or  more 
conflicting  objectives.  Various  methods  have  been  studied 
to  solve  such  problems  [10].  Methods  that  transform 
multiple  objective  functions  into  a  single  one  include  the 
weighted  sum  method,  lexicographic  method,  and 
physical  programming.  Other  approaches,  such  as  genetic 
algorithms  [11,  12],  can  be  used  to  solve  multiobjective 
problems  directly  but  perform  badly  when  the  function 
evaluation  is  expensive.  In  recent  years,  game  theory  has 
been  used  to  solve  multiobjective  design  problems, 
especially  for  some  practical  problems  in  engineering 
[13].  Rao  [14]  proposed  a  game  based  on  Nash 
equilibrium  to  conduct  optimization  problems  and 
described  the  relationship  between  Pareto- optimal 
solutions  and  game  theory.  Applications  of  game-based 
methods  to  solve  multiobjective  optimization  problems  in 
some  engineering  examples  can  be  found  in  [15,  16]. 

Frequency-hopping  waveform  design  has  been  widely 
studied  recently  for  both  frequency  codes  and  amplitudes. 
Gogineni  and  Nehorai  [6]  formulated  two  objective 
functions  based  on  the  sparse  model.  The  objective 
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function  for  amplitude  matrix  B  is  related  to  the  code 
matrix,  denoted  as  C.  However,  the  objective  function  for 
C,  developed  based  on  block  coherence,  is  independent  of 
B,  which  makes  it  difficult  for  us  to  apply  game  theory  to 
solve  this  joint  problem.  The  frequency-hopping 
waveforms  used  in  [5]  based  on  the  ambiguity  function 
made  the  assumption  that  the  amplitudes  for  all 
transmitters  and  frequencies  are  the  same.  We  generalize 
this  by  considering  various  amplitudes,  and  the  resulting 
objective  function  is  naturally  involved  with  the 
amplitudes.  The  optimal  code  design  based  on  ambiguity 
function  obtains  good  resolution,  and  the  amplitude  design 
based  on  sparse  recovery  improves  the  detection 
performance.  It  is  natural  for  us  to  combine  these  two 
objective  functions,  exploiting  the  advantages  of  both 
designs.  We  propose  to  employ  game  theory  to  solve  this 
joint  optimization  problem  by  viewing  the  two  objective 
functions  as  two  interacting  players.  We  will  show  that  the 
joint  design  improves  the  performance  of  both  matrices  at 
the  same  time.  Note  that,  in  [6],  the  authors  used  the 
strategy  of  amplitude  design  with  separate  (ADS) 
constraints,  which  assigned  the  same  energy  constraint  to 
each  transmitter.  However,  in  practice,  it  makes  more 
sense  to  use  a  sum  of  the  transmitted  energy  constraint 
across  all  transmitters.  That  is,  different  transmitters  may 
have  different  energies,  depending  on  their  respective 
channel  qualities.  Therefore,  we  propose  another  strategy, 
amplitude  design  by  fusing  (ADF)  all  transmitters.  We 
will  show  the  comparative  results  of  these  two  strategies 
through  numerical  examples. 

The  formulated  game  combines  players  whose  strategy 
spaces  consist  of  both  discrete  set  and  continuous  set.  The 
size  of  the  feasible  space  for  code  matrix  is  highly 
dependent  on  the  numbers  of  transmitter  MT  and 
frequency-hopping  choice  K.  Because  the  code  feasible 
space  will  become  extremely  large  as  MT  or  K  increases,  it 
is  almost  impossible  for  us  to  find  the  Nash  equilibrium 
due  to  the  expensive  computational  cost.  However,  the 
simulated  annealing  [17]  algorithm  helps  us  to  find  an 
approximate  optimal  solution  for  the  single  code  objective 
function,  leading  to  an  6 -approximate  equilibrium  (e-AE) 
[18]  for  the  joint  problem. 

Building  on  our  previous  conference  paper  [9],  we 
have  added  quite  a  few  new  points:  for  the  amplitude 
objective  function,  we  have  constructed  a  more  effective 
strategy  by  fusing  all  transmitters’  information  (ADF);  for 
the  game  model,  we  have  elaborated  the  detailed  definition 
of  the  e-AE;  for  the  optimization,  we  have  provided 
insightful  analysis  of  the  convergence  performance  of  the 
proposed  algorithms;  and  last  but  not  least,  we  have 
investigated  far  more  numerical  examples  to  illustrate  the 
effectiveness  of  our  algorithms. 

The  rest  of  this  paper  is  organized  as  follows.  In 
Section  II,  we  present  the  signal  model  for  the  colocated 
MIMO  radar,  including  the  measurement  model  and  the 
sparse  model.  The  game  model  formulation,  together  with 
two  joint  design  algorithms  based  on  game  theory,  one 
applying  a  noncooperative  scheme  and  the  other  applying 


a  cooperative  scheme,  is  stated  in  Section  III.  In  Section 
IV,  we  use  numerical  results  to  show  the  advantage  of  our 
joint  design  over  the  separate  design.  Our  conclusions  and 
directions  for  possible  future  work  are  contained  in 
Section  V. 

II.  SIGNAL  MODEL 

In  this  section,  we  will  describe  the  signal  model  for 
our  radar  system.  We  first  develop  the  measurement  model 
for  MIMO  radar  estimation  problem.  Then  we  transform 
the  measurement  model  to  a  sparse  representation. 

A.  Measurement  Model 

We  assume  that  there  are  MT  transmitters  and  MR 
receivers  in  the  colocated  MIMO  radar  system,  arranged 
in  uniform  linear  arrays.  The  spacing  between  the 
transmitters  is  dj,  and  the  spacing  between  receivers  is  dR. 
Additionally,  we  assume  that  the  targets  are  at  far-field 
with  respect  to  the  radar,  i.e.,  the  direction  of  propagation 
is  approximately  equal  at  each  sensor.  Also,  we  assume 
the  relative  distance  between  any  two  targets  is  much 
smaller  than  their  individual  distances  with  respect  to  the 
radar.  Hence,  all  the  targets  can  be  associated  with  the 
same  direction-of-arrival  [5,  6,  19].  Let  these  arrays  form 
the  same  angle  0  with  the  targets.  Let  L  pulses  comprise  a 
waveform,  and  we  can  write  the  frequency-hopping 
waveform  from  the  mth  transmitter  as 

L  — 1 

=  (1) 


=  V  bm:qej2nCm’‘>Aft  1(q, aqQ  -  qAt), 
q=  o 

and 

A  f  1 ,  if  0  <  t  <  At, 

1|W')  =  |  0,  otherwise. 

7/  and  At  denote  the  pulse  repetition  interval  and  hopping 
interval  duration,  respectively,  and  q  and  Q  represent  the 
hopping  index  and  the  length  of  the  code,  respectively. 

The  duration  of  the  pulse  is  =  QAt,  and  the  bandwidth 
of  the  pulses  is  approximately  KAf.  We  assume  AfAt  =  1. 
The  frequencies  cm>q  of  the  transmitted  signal  during  each 
hopping  interval  and  the  amplitudes  bm>q  of  the  transmitted 
sinusoid  are  the  waveform  design  parameters.  The  optimal 
design  of  the  frequency  hopping  waveform  amounts  to 
choosing  cm >q  and  bm>q  for  all  the  transmitters  and  all  the 
hopping  intervals.  We  assume  each  cm>q  e  {1,  . . .,  K}, 
where  K  is  a  positive  integer.  Further,  to  maintain  the 
orthogonality  of  the  waveforms,  cm>q  satisfies, 

cm,q  /  cm',q,  for  m  /  mf ,  Vq.  (2) 

For  amplitudes,  we  constrain  Z?min  <  \bm,q  \  <  bmax  for  all 
transmitters  and  frequencies.  This  constraint  provides 
control  over  the  power  of  the  transmitted  radar  signals. 
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Further,  we  normalize  the  transmitted  energy  for  each 
waveform  by  assuming  Y!q=o  \bm,q\2  =  1-  For 
convenience,  we  arrange  cm>q  into  an  MT  x  Q  dimensional 
code  matrix  C  =  {cm  q  }mt  x  q  ?  which  describes  all  the 
transmitted  frequencies.  Similarly,  we  arrange  bm>q  into  an 
Mt  x  Q  dimensional  amplitude  matrix 
B  =  [b\-,..  .\bTMT\,  where  bm  =  [bm<  i, . . . ,  bm<Q]T . 

Consider  a  target  at  (r,  v,f)  where  r  is  the  delay  of  the 
target,  v  is  the  Doppler  frequency,  and /is  the  spatial 
frequency: 

dR  sin(6) 

f=  /  ,  (3) 

A 

where  A  is  the  wavelength  of  the  carrier.  We  assume  that 
each  of  the  targets  contains  multiple  individual  isotropic 
scatterers.  The  bandwidth  of  the  transmitted  waveform 
determines  the  resolution  of  the  system.  We  require  very 
high  bandwidth  to  resolve  each  of  the  individual  scatterers 
of  the  target.  Due  to  practical  bandwidth  constraints, 
however,  the  system  cannot  resolve  these  individual 
scatters.  Therefore,  this  collection  of  scatterers  can  be 
expressed  as  one  point  scatterer  that  represents  the  radar 
cross  section  (RCS)  center  of  gravity  of  these  multiple 
scatters  [20].  Therefore,  each  target  has  a 
frequency-dependent  RCS.  The  point  target  assumption 
has  been  widely  used  earlier  in  the  literature  for  both 
colocated  MIMO  radar  [3-6]  and  distributed  MIMO  radar 
[2,  21].  Note  that  our  proposed  approach  based  on  game 
theory  is  also  applicable  to  the  extended  target  case  as 
long  as  we  can  formulate  corresponding  objective 
functions  based  on  different  criteria. 

The  target  response  at  the  kth  receive  antenna  is  a 
summation  of  all  reflected  signals  from  all  emitters, 
expressed  as 

Mt 

yk(t )  =  E  am,qum(t  -  r)en^tej2,f(ym+k)  +  ek{tX  (4) 

m= 1 

where 

L- 1 2-1 

MO  =  E  E  bm,qei27TCm-qAf(t~Tl\o,* t){t  -  qAt  -  T,). 

1=0  q=  0 

(5) 

Here,  y  =  dj/dR,  am,q  represents  the  target’s  RCS  and 
ek(t)  is  the  additive  noise  received  at  the  kth  receiver, 
assumed  to  follow  Gaussian  distribution.  Equation  (4) 
gives  the  measurement  model  for  one  target. 

Now,  we  consider  the  situation  of  multiple  targets.  We 
assume  that  there  are  R  targets  in  the  illuminated  region. 
Based  on  the  assumption  that  all  the  targets  are  far  located 
from  the  antennas,  the  angle  0  is  assumed  to  be  the  same. 
Therefore,  the  spatial  frequency  is  independent  of  targets. 
Therefore,  the  received  signal,  which  is  a  summation  of  the 
reflected  signals  from  all  the  targets,  can  be  expressed  as 

MT  R 

yk(t )  =  EEflL“~'"(?  -  r  +  ek{t). 

m= 1  r= 1 

(6) 


Note  that  the  delay  and  Doppler  are  all  target  dependent  in 
the  multiple  targets  case.  Besides,  the  RCS  will  also  be 
target  dependent,  expressed  as  armq.  After  sampling  the 
received  signal,  we  obtain 

mt  r  l- l  <2-1 

yk(n)  =  E££E  <«b^eJ2,tCm*AnnTs-T,-Tr) 

m=  1  r= 1  /=()  q=  0 

X  1(0, AO (nTs  -  qAt  -  T,  -  xr)ej2nvrnTs 
x  ej2nfiym+k)  +  ek(n), 

Wn  =  1, . . . ,  N,  where  A  is  the  total  number  of  samples  at 
each  receiver  during  one  processing  interval  and  Ts 
denotes  the  corresponding  sampling  interval. 

B.  Sparse  Model 

Sparsity-based  approaches  have  been  broadly  used  for 
signal  processing  in  the  radar  field  [19,  22-25].  Suppose 
we  discretize  the  delay  and  Doppler  space  into  D  and  W 
uniformly  separated  grid  points.  Generally,  the  values  of  D 
and  W  can  be  very  large.  For  convenience,  we  restrict  their 
values  to  be  smaller  numbers  by  restricting  our  interested 
region  to  a  narrow  one.  Therefore,  we  have  a  total  of  DW 
number  of  grid  points,  among  which  only  R  correspond  to 
the  real  targets.  Let  r d  and  vw  represent  the  delay  and 
Doppler  of  the  grid  point.  For  each  grid  point,  we  define 
the  basis  function  as 

$m,k,q(n,d,  w) 

L- 1 

ej2jrcm,qAf(nTs-Ti-Td ) 

1=0 

x  lo,A tinTs  -  qAt  -  7]  -  rd)ej2*v”nTsej2xf(ym+k)m 

Stacking  the  basis  function  according  to  samples,  we 
obtain  an  N  x  1  vector 

m,k,q(d ,  W)  =  [yjfmXq(  1>  tfrm,k,q(N ,  d,  . 

Then  we  stack  \lsm,k,q(d,  w)  with  respect  to  receivers  into 
an  NMr  x  1  vector 

fm,q(d,  w)  =  [\j/m,l,q(d,  wf ,  .  .  .  ,  \frm,MR,q(d,  V - 

Now,  each  irm,q(d,  w)  is  the  basis  vector  for  a  different 
transmitter  and  frequency.  For  all  transmitters  and 
frequencies,  we  further  stack  4rm,q(d,  w)  into  an 
N  Mr  x  Mt  Q  matrix 

W(d,  w)  =  [i/q,i (d,  w),  . . . ,  fyQ(d ,  w),  . .  . ,  irMT,Q(d,  w)]. 

Considering  all  the  combination  of 

(< di ,  wj),  i  =  1, . . . ,  D,  j  =  1, . . . ,  W,  we  can  finally 

stack  ^(d,  w)  into  an  NMR  x  DWMTQ  matrix 

^  =  [^(<^1,  w\),  . . . ,  ^(d\,  Ww ),  •  •  • ,  ^(do,  ww)l  (7) 

Equation  (7)  is  the  dictionary  matrix,  defining  the  basis 
elements  of  the  sparse  representation.  Considering  all  the 
different  transmitters  and  frequency  intervals,  we  stack 
arm  qbm,q  into  an  MTQ  vector 

x  =  [$i  1^1,1,  . .  • ,  Qb\  q,  .  .  .  ,  aMT,Q^MT,Q\  • 
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Now,  we  define  the  sparse  vector  as 


is  defined  as 


x(d,  w)  = 


*r, 

0, 


if  ( Td,Vw)  =  (Tr,Vr ), 

otherwise. 


Further,  we  stack  the  vectors  x{d,  w)  corresponding  to 
different  delay  and  Doppler  grid  points  to  obtain  a 
DWMtQ  dimensional  block- sparse  vector 

x  =  [x(l,  l)T, x(d,  w)T, x(D,  W)T]T. 


In  this  vector,  there  are  only  R  nonzero  blocks, 
corresponding  to  different  targets.  Additionally,  we  stack 
the  measurements  and  noise  samples  at  all  receivers  to 
obtain  the  measurement  model 


y  =  Vx  +  e,  (8) 

where  y  =  [j[,  yl,...,  yTMR]T ,  an  NMR  x  1  vector; 
yk  =  yk( 2)>  •  •  -  yk(N)]T >  an  N  x  1  vector; 

e  =  [e\ ,  e\, . . . ,  eTMR\T ,  an  NMR  x  1  vector;  and 
ek  =  [ek(l),ek(2),...,ek(N)]T,<mN  x  1  vector.  Owing 
to  the  orthogonality  of  the  waveforms,  block-matching 
pursuit  (BMP)  [26]  is  suitable  for  our  problem.  We  will 
use  the  BMP  method  to  recover  the  unknown  target 
parameters  from  the  measurements. 


III.  JOINTLY  OPTIMAL  DESIGN  USING 
GAME  THEORY 

Researchers  have  studied  and  optimally  designed  the 
amplitudes  and  frequency-hopping  codes  separately, 
achieving  improved  performance.  In  this  section,  we  will 
present  the  objective  functions  for  joint  design  of  the 
frequency-hopping  waveforms.  The  function  with 
amplitudes  is  based  on  sparse  recovery,  whereas  the 
function  with  frequency-hopping  codes  is  based  on  the 
ambiguity  function.  Then  we  combine  the  two  objective 
functions,  jointly  designing  the  waveforms  using  game 
theory. 

A.  Objective  Function  for  Frequency-Hopping  Codes 

The  ambiguity  function  characterizes  the  resolution  of 
radar  waveforms  and  has  been  used  as  an  effective  tool  to 
design  radar  systems.  Similarly,  we  apply  the  MIMO  radar 
ambiguity  function  to  design  the  frequency-hopping 
waveforms. 

For  frequency-hopping  code  design  [5],  to  obtain  a 
sharp  ambiguity  function,  we  need  to  design  the  pulses 
{0m (01  so  that  the  following  objective  function 


Mt  —  1  Mj  —  1 

fi(r,  /,  /')  =  E  E  V27r(/m-/W)y  (9) 

m=  0  m'=  0 


r*Jr) 


<2-1  <2-1 

=  EE  bm,qbm',q'X  (T  (<7  <?)A  t ,  (^Cm  q  Cm'q')A.f) 

q=  0  q'=  0 

x  ej2x&f((cm,q-cmr  q,))qAtej2nAfcm,tq,T 


with  xrect(G  v)  being  the  single  input/multiple  output 
ambiguity  function  of  the  rectangular  pulse  s(t),  given  by 

pAt 

Xrect(r,  v)  =  /  s(t)s(t  +  r)ej27TTdt. 

Jo 

However,  to  achieve  good  system  resolution,  we  need  to 
eliminate  the  other  peaks  in  Q(z,  /,  /')  not  on  the  line 
{(r,  /,  f')\r  =  0,  /  =  /'}.  We  solve  this  by  adding 
penalties  on  these  peaks,  forcing  the  energy  to  be  evenly 
spread  over  the  delay  and  spatial  frequency  spaces.  One 
way  to  achieve  this  goal  is  to  minimize  the  p-norm  of 
Q(z,  /,  /').  The  resulting  optimization  problem  is 

/oo  p  1  p  1 

/  /  |£2(r,  /,  f)\pdfdfdr, 

-oo  Jo  Jo 

subject  to  cmfq  e  {0,  1, . . . ,  K  —  1}, 

Cjn,q  7“  Cmr,q->  for  W  tfl  , 


When  we  consider  the  sparse  recovery  model,  the  delay 
range  is  [0,  rD].  Therefore,  the  optimization  problem  can 
be  reduced  to 


min cfP(B,C)=fT  f  f 
Jo  Jo  Jo 


|£2(t,  /,  f')\pdfdf'dz. 

(10) 


B.  Objective  Function  for  Amplitudes 

BMP  is  a  sparse  recovery  method  for  signals  that 
exhibit  block  sparse  structure,  and  we  will  use  the  BMP 
method  to  estimate  the  target  RCS,  adaptively  designing 
the  amplitudes  of  frequency-hopping  waveforms  [6]. 

Recall  that  the  nonzero  element  of  the  sparse  vector  x 
is  the  product  of  arm  q  and  bm,q,  and  the  design  parameters 
are  bm,q.  During  the  initialization  step,  we  set  bmA  =  1. 
Therefore,  the  nonzero  entries  of  the  sparse  vector  x 
depend  only  on  the  attenuation  arm  .  Hence,  we  obtain 
arm  q  as  the  estimates  of  the  target  attenuations  after  sparse 
support  recovery.  We  use  arm  q  to  replace  arm  q  in  the 
following  design  problem.  In  practice,  provided  enough 
measurements  and  high  signal-to-noise-ratio  (SNR),  we 
expect  to  achieve  the  estimation  of  arm  with  high 
accuracy.  We  define  xrm  to  be  the  summation  of  the 
energies  of  the  estimates  for  target  r  and  transmitter  m 

<2-i 

r  -  V  b2  i dr  i2 

Am  —  um , q \um,q  I  * 

q=  0 


is  sharp  around  the  line  {(r,  /,  /') \r  =  0,  /  =  /'},  where 
/  and  /'  represent  the  normalized  target’s  true  spatial 
frequency  and  the  assumed  spatial  frequency  at  the 
receiver,  respectively.  In  (9),  the  cross-correlation  function 


Then  we  have  the  vector  xm(bm )  =  [x^(bm),  . . . ,  xp(bm) ]. 
With  the  goal  of  estimating  all  the  R  targets,  we  want  to 
maximize  the  smallest  recovered  estimate.  We  propose  to 
use  the  following  two  optimization  strategies. 
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1)  We  maximize  the  smallest  recovered  estimate  in 
xm(bm)  f°r  each  transmitter.  Therefore,  we  have  MT 
optimization  problems  corresponding  to  Mj  transmitters. 
They  are  independent  of  each  other,  with  separate 
constraints.  We  denote  this  strategy  as  ADS  constraints. 
The  optimization  problem  for  transmitter  m  is 

ma xbm  min,.ei . R{xrJbm)\, 

subject  to  \bm,q\  ^  bmil, ,  |  ^  b|Tlax  • 

e-1  (11) 

X>«,,|2  =  1. 

q= 0 

The  objective  of  (1 1)  is  equivalent  to 

min bm  fm(bm ,  C)  =  maxrei)  ?^{Z  Ym(Z*m)},  (12) 

where  Z  is  a  large  constant,  guaranteeing  that  Z  —  xrm{bm) 
is  nonnegative. 

2)  We  maximize  the  smallest  recovered  estimate, 
obtained  by  fusing  all  the  MT  transmitters.  Considering 
that  different  transmitters  may  have  different  energies,  we 
use  a  sum  of  the  transmitted  energy  constraint  across  all 
Mt  transmitters.  We  denote  this  strategy  as  ADF  all 
transmitters.  The  optimization  problem  is 

1Mt 

'Y^xrm(bm)  ■ , 

m  =  1 

subject  to  | bm,q\  ^  ^min?  \bm,q\  —  ^max?  (13) 
Mt  Q- 1 

EEiv,i2  =  3. 

m= 1 g=0 


Therefore,  the  optimization  problem  (12)  is  equivalent  to 

min*  fs(B,  C).  (16) 

Now,  we  have  two  objective  functions,  fs (B,  C ) 
corresponding  to  amplitude  design  and  fp(B,  C ) 
corresponding  to  code  design.  We  assume  that  each  player 
is  associated  with  one  objective  function.  Therefore,  we 
have  two  players.  The  cost  function  for  the  first  player  is 
chosen  as 

MB,C)  =  fp(B,C).  (17) 

The  cost  function  for  the  second  player  is 

fi(B,  C)  =  fs(B,  C).  (18) 

(B,  C )  are  the  design  variables.  The  first  player  wants  to 
choose  parameters  C  that  minimize  his  or  her  cost 
function  fi(B,  C),  and  similarly  the  second  player  wants  to 
find  variables  B  to  minimize  his  or  her  own  cost  function 
/2(Z?,  C).  The  strategy  spaces  for  the  two  players  are 
respectively 

B  —  {B\\bm,q\  >  bm[n,  \bm,q\  <  ^max? 

<2-1 

^2\bm,q\2  =  l,m  =  1, . . . ,  Mt}, 

9=0 

and 

c  =  [C\cm,q  e  {1,  2, . . . ,  K}m?Q,  Cm,q  #  cm’A,  for  m  #  m’}. 

If  we  consider  ADF,  then  in  our  joint  design  problem 
we  have  two  objective  functions.  The  differences  in  the 
case  of  ADS  are  the  second  player’s  cost  function  and  its 
strategy  space: 


Note  that  the  energy  constraint  is  3,  making  the 
summation  of  energy  the  same  as  with  ADS.  Similar  to 
ADS,  we  get  the  equivalent  form: 


min#  f(B,C)  =  maxrei 


Mj 

*m  (bm  ) 


(14) 


C.  Game  Model 

A  normal  strategic  game  is  a  model  of  interacting 
decision  makers,  consisting  of  players,  their  strategies,  and 
the  players’  cost  functions  [27].  Each  player  chooses  one 
strategy  from  his  corresponding  set  of  possible  strategies. 
The  goal  of  the  players  is  to  choose  strategies  that 
minimize  their  own  cost  functions. 

If  we  consider  ADS,  then  in  our  joint  design  problem 
we  have  Mj  +  1  objective  functions.  As  for  the  Mj 
objective  functions  for  amplitude  design,  their  variable 
choices  are  independent  of  each  other.  It  means  that  the 
choice  of  any  bf  is  irrelevant  to  the  choice  of  bj  for  i  /  j. 
Accordingly,  we  write  these  MT  cost  functions  into  one 
summation  function: 

Mj 

fs(B,C)  =  YJfm(bm,C).  (15) 

m= 1 


MB,  C )  =  f(B,  C ),  (19) 


13  —  ,q\  —  bm{n,  —  bmax,  ^  ^  ^  ^  \bm,q  I  —  3}. 

m= 1 q= 0 

( B ,  C)  denotes  a  profile  of  actions  by  the  two  players. 
A  Nash  equilibrium  is  a  profile  of  strategies  such  that  the 
strategy  for  each  player  is  an  optimal  response  to  the 
strategy  of  the  other  players.  Supposing  (B *,  C*)  is  a  Nash 
equilibrium  for  this  game,  then  it  should  satisfy 

/i(«*,C*)</i(i»,C*),  VfleS, 
and 


h(B\  C*)  <  f2(B*,  C),  VC  g  C. 

The  feasible  space  C  for  player  2  is  discrete.  Owing  to 
the  numerous  choices  of  C,  up  to  KMtQ  ,  it  is  almost 
impossible  for  us  to  find  the  global  minimal  point  for  the 
cost  function /i,  making  it  difficult  to  find  the  Nash 
equilibrium.  For  this  optimization  problem,  we  prefer  to 
use  the  simulated  annealing  algorithm,  which  is  quite 
suitable  [17].  One  problem  is  that  the  feasible  space  for 
the  code  matrix  is  extremely  large.  Nevertheless  simulated 
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annealing  achieves  an  acceptable  solution,  yielding  a  good 
approximation  to  the  global  optimum,  the  e-AE  [18]. 

Definition  1  Let  G  =  (N ,  A,  f  :  A  ->  RN)  be  an 
N -player  game  with  action  sets  A  =  A\  x  . . .  x  AN  and 
cost  functions  f  =  [f\,  . . . ,  /  N]T .  Suppose  e  is  a 
nonnegative  parameter,  a  strategy  vector 
(al ,  . . . ,  a $[)  e  A  is  an  e-AE  for  G  if 

Mai  ...,a*N)<  Mai . . . ,  a*_v  at,a*+l,  ...,<)  +  6, 

G  A[ ,  i  g  N. 

Our  dehnition  here  is  the  e-AE  in  a  pure  strategy  game, 
which  is  a  different  definition  from  that  used  in  most  of 
the  literature  for  a  mixed  strategy  game.  In  our  problem, 
we  will  focus  on  finding  the  e-AE  for  the  proposed  game. 

D.  Optimization  Algorithm  Using  Game  Theory 

1)  Noncooperative  Case :  First,  we  consider  the 

noncooperative  case,  with  each  player  having  no 
knowledge  of  the  other  players’  information.  They  know 
only  their  own  information.  The  algorithm  is  expressed  as 
follows: 


Initialize  Co  randomly  from  feasible  space  C,  and  initialize  bm o,  m  = 
l,  ,  Mj  for  ADS  or  initialize  B  for  ADF,  whose  elements  are  set  to 
be  equal. 

At  step  k,  fix  Ck,  then  conduct  the  single  objective  optimization  design 
for  player  2: 

minB  f2(B,  Ck), 

resulting  in  the  optimized  Bk+ \.  Using  the  newly  generated  Bk+ 1 ,  we 
optimize  player  l’s  objective  function 

mine  fi(Bk+i,C), 

obtaining  Ck+ 1. 

Replace  Bk,Ck  with  Bk+\,  Ck+\  and  repeat  the  above  step  until  an 
e-AE  is  satisfied  or  k  is  large  enough. 


We  apply  the  convex  programming  software  CVX  [28,  29] 
to  solve  the  single  amplitude  optimization  problem.  The 
simulated  annealing  algorithm  solves  the  code 
optimization  problem,  which  has  a  large  discrete 
feasible  set. 

The  convergence  of  the  proposed  optimization 
algorithm  is  an  important  issue.  However,  the  cost 
functions  (10),  (12),  and  (14)  in  our  problem  are  rather 
complex.  Besides,  the  size  of  the  discrete  feasible  space 
for  code  matrix  will  be  extremely  large  as  MT  or  K 
increases.  Both  of  these  two  reasons  make  it  difficult  for 
us  to  analytically  prove  the  convergence,  which,  however, 
is  shown  through  numerical  examples  in  Section  IV. 
Nevertheless,  we  would  like  to  add  the  following  remarks 
regarding  the  convergence  issue. 


Remarks  First,  we  define  four  notations,  two  at  a  time: 

ftc  =  fi(Bk-UCk)  (20) 

tfc  =  fi(Bk-i,Ck).  (21) 

These  are  the  first  and  second  cost  functions  at  step  k  after 
designing  only  C,  using  the  former  amplitude  strategy 
Bk_i  of  step  k  -  1  and  the  newly  obtained  code  strategy 
Ck.  Now  we  define 

fiB  =  fi(Bk,  ck)  (22) 

=  fi(Bk,  Ck).  (23) 

These  are  the  first  and  second  cost  functions  at  step  k  after 
designing  both  C  and  B,  using  the  newly  obtained  Bk  and 
Ck.  Considering  the  first  player f\,  due  to  the  conflict 
between  these  two  players,  we  expect  that  f\c  would 
decrease  compared  to  f\Bl  and  that  f*B  would  increase 
compared  to  f\c.  Note  that  the  increase  and  decrease  are 
not  strict.  Namely,  there  is  some  variation,  and  this  is 
explainable  from  a  game  theory  point  of  view.  Therefore, 
if  convergence  exists,  these  two  cost  functions  f\c  and  f\B 
should  cross  with  each  other  somewhere  after  a  number  of 
iterations.  We  define  this  crossing  point  as  the  convergence 
point  with  f\c  =  f\B  1 ,  which  means  the  code  matrix  does 
not  change  at  step  k.  Using  the  same  code  matrix,  the 
minimization  process  for  the  second  player  would  not 
change,  resulting  in  the  same  amplitude  matrix.  This  is 
exactly  what  convergence  means.  Thus,  in  the  algorithm, 
one  stop  criterion  is  chosen  as  f*c  =  f^B  1 .  It  is  the  same 
case  with  the  second  player.  We  will  show  the 
convergence  performance  through  numerical  examples. 

Second,  our  algorithms  converge  to  different  points 
with  respect  to  different  trials.  Namely,  the  convergence 
points  are  not  fixed.  This  is  reasonable  because  the  code 
space  is  extremely  large;  thus,  we  cannot  find  a  global 
optimal  solution  for  the  first  player,  namely /i.  We  reduce 
the  original  big  problem  into  a  smaller  problem,  achieving 
lower  complexity  at  the  price  of  solution  optimality. 
However,  we  want  to  emphasize  that  the  obtained 
convergence  points  perform  sufficiently  well,  especially 
when  we  conduct  target  estimation.  We  will  verify  this 
through  numerical  examples  in  Section  IV. 

Third,  all  the  obtained  convergence  points  satisfy  the 
AE  conditions  in  Definition  1 . 

Proof  Following  the  discussion  in  the  first  item,  we 
denote  the  convergence  point  as  f\(B*,  C*)  and 
/2(Z?*,  C*).  On  the  other  hand,  suppose  that  the  global 
optimal  point  of  player  1  with  fixed  B*  is  C**.  If  we  let 

6  =  ffB\  C*)  -  MB*,  C**),  (24) 

we  can  obtain 

MB*,C*)<MB*,C)  +  €.  (25) 

For  player  2,  MB*,  C *)  is  the  global  minimal  point 
for  MB,  C *)  with  fixed  C*.  Thus  we  have 

MB*,  C*)  <  MB,  C*)  <  MB,  C*)  +  6.  (26) 
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Equations  (6)  and  (7)  are  exactly  the  conditions  for 
(. B *,  C*)  to  be  an  e-AE  in  Definition  1. 

2)  Cooperative  Case :  In  the  cooperative* 1  case,  we 
suppose  each  player  knows  part  of  the  other  players’ 
information  by  incorporating  their  cost  functions  in  his  or 
her  own  cost  function.  The  resulting  cost  function  for  each 
player  is 

f*  =  +  £  *'■„•//•  (27) 

J¥* 

where  wtj  =  1,  =  Wjj.  In  our  problem,  we 

choose  the  second  player’s  cost  function  to  remain  the 
same,  without  considering  the  first  player’s  influence.  All 
that  changes  is  the  first  player’s  objective  function. 
Additionally,  we  replace  the  absolute  cost  function  with  a 
relative  cost  function.  Details  are  shown  as  follows: 


Initialize  Co  randomly  from  feasible  space  C,  and  initialize  bm o,  m  = 

1 ,  . . . ,  Mj  for  ADS  or  initialize  B  for  ADF,  whose  elements  are  set  to 

be  equal. 

At  step  k,  fix  Ck,  then  conduct  the  single  objective  optimization  design 

for  player  2: 

min#  f2(B,  Ck), 


attenuations  for  each  target 

a 1  =  [0.4,  0.2,  0.5,  0.8,  0.1,  0.4,  0.3], 
a2  =  [0.6,  0.2,  0.8,  0.9,  0.1,  0.3,  0.5], 
a3  =  [0.2,  0.4,  0.3,  0.7,  0.4,  0.1, 0.9], 

We  can  use  this  attenuation  information  to  estimate  the 
RCS  corresponding  to  different  hopping-frequencies  and 
transmitters. 

When  considering  sparse  recovery,  we  discretize  the 
target  delay-Doppler  space.  The  grid  size  in  delay  is 
At  =  1  /x s,  and  the  Doppler  dimension  is  10  Hz.  The 
delay  space  is  uniformly  divided  in  the  interval 
[0,  10]  /xs,  and  the  Doppler  grid  points  lie  uniformly  in  the 
interval  [0,  100]  Hz.  Therefore,  we  have  a  total  of  V  = 

11  x  11  =  121  grid  points,  out  of  which  only  three 
correspond  to  the  true  targets.  We  assume  the  true  delays 
and  Doppler  shifts  of  the  targets  are 

[r1 *,  r2,  r3]  =  [4,  9,  1]  /xs,  and 
[v\  v2,  v3]  =  [80,  60,40]  Hz. 


resulting  in  the  optimized  Bk  +  i .  Using  the  newly  generated  Bk  + 1 ,  we 
optimize  player  l’s  new  objective  function 


mine  f*  = 


Mj 

E 


m=l 


Wm 


fm(bm,k+ 1,  C) 
fm(bm,ki  C  k) 


+  W>Mt  +  1 


fi(Bk+uC) 
fi(Bk,  Ck)  ’ 


obtaining  Ck  + 1 . 

Replace  Bk,Ck  with  Bk+ 1,  Ck+ 1  and  repeat  the  above  step  until  an 
e-AE  is  satisfied  or  k  is  large  enough. 


Note  that  we  assume  we  know  the  approximate  target 
locations,  namely  within  the  delay  interval  [0,10]  /xs  and 
Doppler  interval  [0,  100]  Hz.  When  we  consider  a  real 
problem  with  a  large  surveillance  region,  this  approximate 
knowledge  of  the  target  information  can  be  obtained  by 
conducting  target  detection  beforehand  or  by  using  a 
coarse  grid  first  [30].  We  define  the  SNR  as 


SNR  =  10  log 


dB, 


The  convergence  analysis  for  the  cooperative  case  is 
similar  to  that  of  the  noncooperative  case. 

IV.  NUMERICAL  SIMULATIONS 

In  this  section,  we  use  numerical  examples  to 
demonstrate  the  performance  improvement  obtained  by 
joint  design  using  game  theory.  We  consider  a  uniform 
linear  transmitting  array  with  transmitter  and  receiver 
numbers  Mj  =  3  and  Mr  =  3,  respectively.  Choose 
0  =  30°  and  let  the  array  spacing  dT  =  dR  =  |.  The  length 
of  the  frequency-hopping  code  Q  equals  5.  The  number  of 
frequencies  K  equals  7.  Suppose  L  =  10  pulses  comprise  a 
waveform.  The  chip  duration  is  At  =  1  /xs,  whereas  the 
time  interval  between  pulses  is  3  ms.  The  minimum 
hopping  frequency  interval  is  Af=  1  MHz.  Because  we 
chose  K  =  1 ,  the  maximum  hopping-frequency  is  KAf= 

1  MHz.  Therefore,  we  sample  at  a  Nyquist  rate  of 
14  x  106  samples/s.  Further,  we  suppose  three  targets  are 
present  in  the  scenario.  We  specify  the  amplitudes  of  K 


1  The  cooperative  case  here  has  a  different  definition  from  cooperative 
game.  We  consider  the  coalition  between  different  players. 


where  E{*}  denotes  the  expected  value  of  {•}. 

In  the  following  numerical  examples,  we  investigate 
the  performance  of  noncooperative  joint  design  with  ADS 
(NC-ADS)  and  cooperative  joint  design  with  ADS 
(C-ADS)  in  sub-Sections  IVA-IVC.  Then,  in  sub-Section 
IVD,  we  compare  the  performance  of  joint  design 
employing  ADS  with  those  employing  ADF  (NC-ADF 
and  C-ADF).  The  convergence  issue  is  investigated  in 
sub-Section  IVE. 

A.  Frequency-Hopping  Code  Design 

We  compare  the  performance  of  the  proposed  design 
method  and  the  existing  separate  design  methods  using  the 
empirical  cumulative  distribution  function  (CDF)  of 
|£2(r,  /,  f)\  applied  in  [5].  We  use  the  Monte  Carlo 
method  by  sampling  from  the  function  |£2(t,  /,  f')\,  and 
plot  the  percentage  of  samples  of  \C2(r,  f,  f')\  less  than 
different  magnitudes.  Thus,  the  larger  the  CDF  for  a 
specific  magnitude,  the  fewer  undesired  peaks  the 
waveform  yields,  and  the  better  the  waveform  performs. 
We  have  normalized  the  greatest  value  to  0  dB. 
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Fig.  1.  Empirical  CDF  of  |£2(r,  f,  f')\  for  five  different  design 
methods. 

Fig.  1  shows  the  results  of  five  different  design 
methods:  without  optimal  design,  optimize  only  C, 
NC-ADS,  C-ADS,  and  optimize  only  B.  Because  the  CDF 
criterion  is  mainly  designed  to  measure  the  performance 
improvement  resulting  from  designing  code  matrix  C,  it  is 
not  surprising  to  see  that  the  method  designing  only  C 
achieves  the  best  performance.  When  designing  B  only, 
the  performance  becomes  worse  than  even  the  case 
without  any  optimal  design.  This  is  explainable  from  a 
game  theory  point  of  view.  Each  player  tries  to  choose 
strategies  that  minimize  his  or  her  own  cost  function, 
which  will  not  necessarily  contribute  to  the  other  players’ 
benefits.  In  this  example,  it  degrades  the  other  players’ 
performance.  Game  theory-based  joint  design  performs 
much  better  than  that  designing  only  B.  Owing  to  the 
degraded  performance  caused  by  designing  B ,  the  joint 
design  performs  a  little  worse  than  that  designing  only  C. 
Note  that  the  C-ADS  performs  better  than  the  NC-ADS 
and  comes  closest  to  the  case  of  designing  C  only. 

To  show  the  relative  superiority  of  our  design  methods, 
we  also  compare  the  cross-correlation  function  of  the 
waveforms  generated  by  the  proposed  methods  with  the 
one  designed  based  on  block  coherence  [6].  We  wish  to 
obtain  small  sidelobes. 

From  Fig.  2,  it  is  quite  evident  that  the  joint  design 
methods,  both  NC-ADS  and  C-ADS  result  in  a  much 
better  cross-correlation  function.  The  low  sidelobes  of  the 
cross-correlation  function  corresponding  to  the  joint 
design  methods  are  much  smaller  than  those  of  the 
counterparts  of  the  waveform  designed  using  block 
coherence.  The  reason  for  the  superiority  of  the  joint 
design  methods  is  because  these  designs  consider 
eliminating  irrelevant  peaks  of  |£2(r,  /,  /') |,  which  is 
highly  related  to  the  correlation  function. 

B.  Amplitude  Design 

We  use  the  performance  metric: 

minis 

A  =  - — , 

maxxs 


Without  Optimal  Design  Block  Coherence  Based  Design 


Fig.  2.  Cross-correlation  function  ,(t),  with  m  =  m'  =  1,  of 

b  m,m'y  y’  ’ 

waveforms  generated  by  proposed  methods  and  one  using  the  block 
coherence  measure.  Abscissa  axis  is  delay  (r/A t),  and  vertical  axis  is 
cross-correlation  value. 


SNR  (in  dB) 

Fig.  3.  Performance  metric  A  comparison  of  five  different  design 
methods. 

where  S  and  S  denote  the  recovered  support  sets  of  the 
correct  and  incorrect  target  indices,  respectively.  The 
numerator  and  denominator  of  A  denote  the  weakest 
target  reconstruction  and  the  strongest  reconstruction  of 
the  incorrect  target  indices,  respectively.  Therefore,  A  >  1 
guarantees  that  the  correct  target  indices  dominate  the 
others,  providing  a  measure  of  the  recovery  accuracy.  We 
want  this  metric  to  be  as  large  as  possible. 

Fig.  3  shows  the  resulting  performance  metrics  over 
various  SNR  using  different  design  methods.  Because  the 
performance  metric  is  mainly  applied  to  measure  the 
performance  improvement  resulting  by  designing 
amplitude  matrix  B ,  similar  to  what  we  mentioned  earlier, 
it  is  not  surprising  to  see  that  the  method  designing  only  B 
achieves  relatively  good  performance.  When  designing  C 
only,  at  some  specific  SNR,  the  performance  becomes 
even  worse  than  the  case  without  optimal  design.  This  is 
also  explainable  from  a  game  theory  point  of  view.  Game 
theory-based  joint  design  performs  much  better  than  one 
designing  only  C.  Owing  to  the  degraded  performance 
caused  by  designing  C,  the  NC-ADS  performs  a  little 
worse  than  designing  only  B.  However,  the  C-ADS 
achieves  the  best  performance,  better  even  than  the  result 
from  designing  B  only.  This  superiority  is  achieved  by 
cooperating  between  the  players,  sharing  each  other’s 
information  about  cost  functions. 
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Fig.  4.  Target  estimates  at  SNR  of  -21.58  dB  by  designing  only  C. 
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Fig.  5.  Target  estimates  at  SNR  of  -21.58  dB  by  designing  only  B. 


C.  Sparse  Support  Recovery 

As  we  assumed,  three  targets  are  present  in  the 
illuminated  space.  We  used  30  iterations  for  the  BMP 
algorithm.  We  have  assumed  the  targets  will  lie  exactly  on 
the  grid  points.  However,  in  reality  they  may  lie  in 
between  two  grid  points,  which  can  be  a  result  of  the  grid 
size  not  being  small  enough.  When  such  modeling  errors 
occur,  the  authors  in  [21]  have  demonstrated  that  the 
reconstruction  algorithm  BMP  will  map  the  estimates  to 
the  grid  point  that  is  closest  to  the  true  target  parameter. 
The  same  holds  for  the  results  in  this  paper  because  we  are 
using  BMP.  The  reconstructed  target  parameters  at  an 
SNR  of  -21.58  dB  are  shown  in  Figs.  4-6,  corresponding 
to  three  different  designs.  Red  squares  are  the  true 
locations  of  the  three  targets.  For  these  two-dimensional 
plots,  the  intensity  of  the  grid  point  corresponds  to  the 
specific  reconstruction  energy. 

Fig.  4  shows  the  performance  achieved  by  designing  C 
only,  for  which  none  of  the  three  targets  are  correctly 
recovered.  Besides,  some  delay  and  Doppler  are  wrongly 
estimated.  For  the  case  designing  only  B ,  shown  in  Fig.  5, 
only  one  target  (4  /xs,  80  Hz)  is  estimated  correctively. 
However,  at  the  same  SNR,  our  C-ADS  joint  design  based 
on  game  theory  successfully  estimates  all  three  targets, 
with  the  three  highest  intensity  points  as  shown  in  Fig.  6. 


Fig.  6.  Target  estimates  at  SNR  of  -21 .58  dB  using  C-ADS  joint  design. 


Fig.  7.  Empirical  CDF  of  |£2(r,  /,  /')  |  for  four  joint  design  methods. 


D.  Performance  Comparison  of  ADS  and  ADF 

In  the  above  subsections,  we  see  that  the  joint  design 
employing  ADS  shows  great  advantage  over  separate 
designs.  In  this  subsection,  we  will  concentrate  on  the 
performance  of  joint  design  using  ADF  and  compare  its 
effectiveness  with  ADS. 

First,  we  consider  the  performance  metric  for 
frequency-hopping  codes,  as  in  sub-Section  IVA.  Fig.  7 
shows  the  results  of  four  joint  designs.  As  for 
noncooperative  designs,  ADF  outperforms  ADS.  Namely, 
the  strategy  of  fusing  and  constraining  all  transmitters 
achieves  better  performance.  We  can  explain  this  by 
considering  that,  for  ADF,  different  transmitters  choose 
their  most  suitable  energy  values  based  on  their  respective 
channel  qualities.  However,  for  ADS,  all  the  transmitters 
are  assigned  equal  energy.  As  for  cooperative  design,  the 
fusion  strategy  loses  its  superiority:  C-ADS  performs 
better  than  C-ADF.  We  explain  this  from  the  view  point  of 
game  theory:  one  player’s  strategy  degrades  the  other 
player’s  performance  much  more  strongly  by  using  ADF 
than  by  using  ADS. 

Next,  we  consider  the  performance  metric  for 
amplitudes,  as  in  sub-Section  IVB.  Fig.  8  shows  the 
comparison  results,  which  are  exactly  the  same  as  those  of 
frequency-hopping  codes.  In  the  end,  we  use  sparse 
support  recovery  to  investigate  the  estimation  performance 
of  the  four  joint  design  methods.  Just  as  in  sub-Section 
IVC,  three  targets  are  present.  The  reconstructed  target 
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Fig.  8.  Performance  metric  A  comparison  of  four  joint  design  methods. 


TABLE  I 

Target  Estimates  at  an  SNR  of -18.96  dB 


Design  Method 

(r\  v1) 

(r2,  v2) 

(r3,  v3) 

NC-ADS 

NC-ADF 

(4  /x s,  70  Hz) 

(4  /xs,  80  Hz) 

(9  /x s,  60  Hz) 

(9  /x s,  60  Hz) 

(1  f! s,  40  Hz) 
(1  /x s,  40  Hz) 

TABLE  II 

Target  Estimates  at  an  SNR  of  -20.63  dB 

Design  Method 

(r\  v1) 

(r2,  v 2) 

(r3,  v3) 

C-ADS 

C-ADF 

(4  /x s,  80  Hz) 

(4  /x s,  90  Hz) 

(9  /x s,  60  Hz) 

(9  /x s,  60  Hz) 

(1  f! s,  40  Hz) 
(1  /x s,  40  Hz) 

parameters  at  an  SNR  of  -18.96  dB  for  NC-ADS  and 
NC-ADF  are  shown  in  Table  I.  We  can  see  that  NC-ADF 
correctly  estimates  all  the  three  targets,  whereas  NC-ADS 
falsely  estimates  the  first  target.  Table  II  shows  the 
reconstructed  target  parameters  at  an  SNR  of  -20.63  dB 
for  C-ADS  and  C-ADF.  The  results  show  that  C-ADS 
performs  better  than  C-ADF.  These  results  are  in 
accordance  with  the  aforementioned  numerical  examples. 

E.  Convergence 

In  this  subsection,  we  provide  examples  to  numerically 
show  the  convergence  of  our  algorithms.  We  have  made 
more  than  50  trials,  and  all  converge  to  an  e-AE  point 
within  k  =  20  iterations.  Note  that  we  consider  NC-ADS 
here,  but  other  algorithms  are  similar.  Figs.  9  and  10  show 
the  convergence  performance  of  both  players  for  nine  of 
these  50  trials.  We  can  see  that  both  players  converge  after 
several  iterations  and  reach  the  e-AE. 

V.  CONCLUDING  REMARKS 

We  proposed  a  joint  optimization  algorithm  using 
game  theory  to  compute  the  adaptive  code  matrix  and 
amplitude  matrix  for  frequency-hopping  waveform,  which 
involves  both  continuous  and  discrete  feasible  spaces.  For 
this  purpose,  we  considered  a  colocated  MIMO  radar  and 
developed  the  received  signal  model  and  the  sparse 
recovery  model.  Based  on  two  objective  functions  derived 
by  using  the  ambiguity  function  and  sparse  recovery,  we 
formulated  a  game  model  with  two  players.  For  amplitude 


Fig.  9.  Convergence  performance  of  player  1  for  nine  trials  using 
proposed  NC-ADS  algorithm.  Horizontal  axis  is  iteration  number  k,  and 
vertical  axis  is  cost  function  of  first  player  f\ .  Blue  starred  line  denotes 
f\B,  and  red  circled  line  denotes /ic- 


Fig.  10.  Convergence  performance  of  player  2  for  nine  trials  using  the 
proposed  NC-ADS  algorithm.  Horizontal  axis  is  iteration  number  k,  and 
vertical  axis  is  cost  function  of  second  player /2.  Blue  starred  line  denotes 
fzc,  and  red  circled  line  denotes  fiB- 


design,  we  constructed  two  effective  strategies:  ADS 
constraints  and  ADF  all  transmitters.  Owing  to  the  large 
size  of  the  discrete  feasible  space,  we  proposed  to  find  an 
e-AE.  Both  the  cooperative  case  and  noncooperative  case 
were  considered  to  optimize  the  frequency-hopping  codes 
and  amplitudes.  We  numerically  demonstrated  the 
advantage  of  jointly  optimal  design  methods  over  separate 
design  methods.  We  concluded  that  the  optimization 
algorithm  simultaneously  chooses  frequency-hopping 
codes  that  obtain  a  sharp  ambiguity  function  and 
amplitudes  that  increase  the  possibility  of  a  relatively 
good  target  return  at  the  same  time.  Additionally,  we 
compared  the  performance  of  ADS  and  ADF,  showing  that 
ADF  outperforms  ADS  for  the  noncooperative  case.  As 
for  the  cooperative  case,  however,  ADF  is  not  as  good  as 
ADS.  In  the  end,  we  numerically  showed  that  our 
algorithms  do  converge. 

In  future  work,  we  will  develop  an  efficient  algorithm 
to  solve  the  global  equilibrium  for  large  discrete  feasible 
sets,  for  which  we  found  only  an  e-AE  in  this  paper.  In 
addition,  we  will  analytically  study  the  convergence  of  the 
proposed  algorithms.  We  will  also  work  on  other  more 
effective  algorithms  by  incorporating  more  performance 
criteria  in  the  constraints  to  deal  with  cases  where  a  bad 
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approximate  equilibrium  exists.  For  sparse  recovery,  we 
will  consider  nonuniform  grid  spacing  to  improve  the 
estimation  accuracy  and  reduce  the  computational 
complexity.  Future  work  will  also  include  applications 
related  to  real  data. 
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